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PREFACE 


This  paper  summarizes  current  research  and  thinking  on  the  role  of  the  instructor 
in  computer-based  training  (CBT).  It  concludes  with  recommendations  on  how  to 
ensure  that  effective  traditional  instruction  instructor  variables  are  incorporated  into 
the  CBT  environment.  This  research  was  conducted  under  the  United  States  Air  Force 
Summer  Faculty/Graduate  Student  Research  Program  and  was  sponsored  by  the  Air 
Force  Office  of  Scientific  Research/AFSC,  United  States  Air  Force,  under  contract 
F49620-88-C-0053.  The  author  would  like  to  thank  the  Armstrong  Laboratory's  Human 
Resources  Directorate,  and  in  particular  the  Technical  Training  Research  Division 
AL/HRT  for  providing  an  environment  supportive  of  this  work.  Several  AL/HRT 
individuals  were  of  specific  help:  Colonel  Rodger  Ballentine;  and  Drs.  Scott  Newcomb, 
and  Hendrick  Ruck.  To  the  rest  of  the  Division  and  also  to  the  Library  staff,  thanks  for 
your  assistance. 


Aooesslor  For 

NT  IS  GP.A&I 
DTIC  TAB 
Unarm  our.oei1 
JustiJTlcati  on. 

By - . 

Distribution/ 

Avp  \  1  '\V_liT  y 


cooes 


'Avail  aod/or 
Special 


Dist, 


MAXIMIZING  ACHIEVEMENT  IN  COMPUTER-BASED  TRAINING  (CBT): 
THE  ROLE  OF  THE  INSTRUCTOR  AND  OTHER  VARIABLES 


SUMMARY 

The  role  of  the  instructor  in  the  computer-based  training  (CBT)  environment  has  typically  not  been 
researched.  Yet,  recent  studies  have  shown  that  the  behavior  and  the  attitude  of  the  instructor  can 
affect  achievement  in  CBT.  Moreover,  the  importance  of  the  instructor  in  traditional  instruction  \TI) 
settings  has  been  well  documented.  This  paper  summarizes  the  important  functions  served  by  the 
effective  Tl  instructor  and  discusses  how  these  functions  can  be  provided  in  CBT.  The  paper  concludes 
with  recommendations  on  how  to  structure  the  CBT  environment  to  ensure  that  achievement  is 
maximized. 


I.  INTRODUCTION 

In  a  series  of  papers  on  computer-based  training  (CBT)  (which  is  used  here  as  a  generic  term  for 
all  types  of  computer-based  training/learning/assistance),  Stephenson  (1989, 1 990a,  1 990b)  discussed 
issues  associated  with  the  CST  instructor.  In  traditional  instruction  (Tl)  the  functions  of  an  effective 
instructor  are  well  known  (Brophy,  1986;  Brophy  &  Good,  1986;  Rosenshine,  1983).  The  role  of  the 
CBT  instructor,  however,  is  essentially  undefined  because  this  area  is  rarely  considered  in  CBT 
research.  This  lack  of  consideration  is  perhaps  based  on  an  underlying  assumption  that  a  properly 
designed  CBT  system  does  not  require  an  instructor.  Yet  recent  research  has  shown  that  the  attitude 
and  the  behavior  of  a  CBT  instructor  can  influence  achievement  (Moore,  1988;  Stephenson,  1990c). 

If  it  can  be  assumed  that  even  in  the  most  automated  CBT  situation  there  will  be  some  sort  of 
instructor  or  course  administrator  present  in  the  learning  facility,  then  the  role  of  that  individual  should 
be  defined.  Responsibility  for  student  success  cannot  simply  be  turned  over  to  CBT  with  the 
expectation  that  by  itself  it  will  produce  maximum  results. 

The  purposes  of  this  paper  are  twofold.  First,  this  paper  attempts  to  define  the  role  of  the  CBT 
instructor  with  regard  to  achievement.  Second,  it  suggests  how  the  total  CBT  environment  can  be 
configured  so  that  appropriate,  effective  Tl  instructor  functions  are  provided  in  CBT. 


II.  GENERAL  PROBLEM 

There  is  a  relatively  high  degree  of  consensus  as  to  what  an  effective  Tl  instructor  does  versus  what 
a  not-so-effective  Tl  instructor  does  (Brophy,  1986;  Brophy  &  Good,  1986;  Rosenshine,  1983).  Early 
CBT  research  (McCombs,  Back,  &  West,  1984;  McCombs  &  Lockhart,  1984)  also  concluded  that  the 
role  of  the  instructor  was  critical  with  regard  to  the  success  of  CBT.  Yet  there  is  still  little  agreement 
or  even  discussion  as  to  what  ?n  effective  CBT  instructor  does.  Because  the  role  of  the  CBT  instructor 
has  not  been  adequately  addressed,  CBT  implementors  do  not  have  a  clear  understanding  as  to  what 
that  role  should  be,  even  though  research  has  shown  that  the  CBT  instructor  can  make  a  difference 
with  regard  to  achievement  (Moore,  1988;  Stephenson,  1990c). 

In  addition,  there  Is  also  the  possibility  that  Tl  instructors  are  hesitant  to  even  adopt  CBT  simply 
because  they  do  not  know  what  their  role  will  be.  Rather  than  venturing  into  the  unknown,  instructors 
resist  changing  from  Tl  to  CBT.  Moreover,  it  has  been  shown  that  the  success  or  failure  of  the  entire 
CBT  system  can  be  in  part  a  function  of  the  instructor  (McCombs  etal.,  1984). 
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This  paper  will  address  the  Issue  of  the  instructor  's  role  in  CBT.  For  discussion  purposes,  this  paper 
will  use  a  formal  (versus  on-the-job),  completely  automated  CBT  system.  Although  such  a  CBT  system 
exists  in  only  a  few  Instances,  using  a  completely  automated  CBT  system  will  permit  the  reader  to  adapt 
this  discussion  to  the  specifics  of  his  or  her  individual  CBT  system. 


III.  THE  EFFECTIVE  INSTRUCTOR  IN  TRADITIONAL  INSTRUCTION 

Major  reviews  by  Brophy  (1986),  Brophy  and  Good  (1986),  and  Rosenshine  (1983)  have 
summarized  those  Tl  instructor  behaviors  which  seem  to  sigrv'icantly  impact  student  achievement. 
These  reviews  produced  a  general  agreement  about  those  Tl  behaviors  which  are  positively  or 
negatively  linked  to  academic  gain.  The  results  are  presented  in  Tables  1  and  2,  respectively. 

Table  1.  Tl  Instructor  Functions  Positively  Related  to  Achievement 


Knowledge  about  course  content  demonstrated 

Businesslike  atmosphere  created 

Organized  atmosphere  created 

Focus  placed  on  academics 

Praise  (for  task  performance)  given  to  students 

Mild  reproach  given  to  students 

Neutral  feedbacx  given  to  students 

High  percentage  of  time  spent  on-task 

Student  behavior  controlled  (academic) 

Student  behavior  controlled  (non-academic/physical) 
Students  warned  versus  threatened  over  misconduct 
Questions  asked 

Feedback  on  task  performance  provided 
Student  behavior  monitored 

Attitude  created  that  students  are  accountable  for  their 
performance/achievement 
Frequent  but  short  interactions  held 
Presentations  are  clear,  structured,  and  organized 


Table  2.  Tl  Instructor  Functions  Negatively  Related  to  Achievement 


Strong  criticism  given  to  students 

Negative  climate  created 

Non-response  questions  asked 

Time  spent  on  non-academics 

Affective  nature  of  course  emphasized 

Instructor  does  not  interact  with  students 

Use  of  silent  reading,  independent  study,  or  written  assignments 


In  addition  to  the  specific  functions  listed  in  Tables  1  and  2,  the  literature  suggests  that  a  critical 
aspect  of  a  successful  (i.e.,  high  academic  achievement)  Tl  classroom  is  the  atmosphere  established 
by  the  course  instructor.  Table  3  summarizes  the  high  achievement  classroom  atmosphere  created 
by  the  effective  Tl  instructor. 
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The  general  conclusions  from  the  effective  Tl  instructor  research  are  that  the  instructor  is  very  much 
a  proactive,  task-oriented,  internal-locus-of-control  individual.  Tne  effective  instructor  knows  the 
course  material,  spends  a  high  percentage  of  time  on-task,  controls  the  environment,  praises  students 
for  task  performance,  and  frequently  interacts  with  the  students  on  a  one-to-one  basis.  As  might  be 
expected,  effective  Tl  instructors  also  present  the  course  material  in  an  appropriate  manner;  i.e. ,  their 
presentations  are  clear,  structured,  and  organized. 

Table  3.  Atmosphere  Created  by  the  Effective  Tl  Instructor 


This  is  my  classroom. 

I  am  in  control. 

I  am  here  for  you  to  learn. 

I  am  going  to  teach  you. 

I  can  teach  you. 

You  can  learn. 

If  you  do  not  learn,  it  is  my  fault. 

You  must  abide  by  the  rules  if  you  are  to  learn  the  material. 
You  will  be  held  accountable  for  your  performance. 

We  must  spend  a  high  percent  of  our  time  on  the  task. 


IV.  CBT  INSTRUCTOR  CONTROL  OF  EFFECTIVE  Tl  INSTRUCTOR  FUNCTIONS 

Stephenson  (1990b)  suggested  that  effective  Tl  instructor  functions  are  dichotomized  in  CBT. 
Effective  Tl  instructor  variables  related  to  presenting  the  course  material  are  primarily  (but  not 
exclusively)  allocated  to  the  CBT  courseware  whereas  class  management  variables  are  primarily 
allocated  to  the  CBT  instructor.  Therefore,  it  appears  that  in  CBT  (versus  Ti)  the  instructor’s  role  has 
shifted  from  that  of  content  presenter  and  course  administrator  to  that  of  course  administrator. 

If  such  a  shift  has  occurred,  then  the  number  of  instructor-controlled  functions  which  can  affect 
student  achievement  is  reduced  in  CBT.  Instead  of  being  able  to  manipulate  both  course  material 
presentation  and  classroom  management  variables,  CBT  instructors  primarily  have  classroom 
management  variables  at  their  disposal.  Table  4  summarizes  those  effective  Tl  instructor  functions 
which  the  CBT  instructor  still  controls.  Moreover,  the  CBT  instructor  still  controls  the  classroom 
atmosphere  variables  listed  in  Table  3. 

CBT  instructors  obviously  have  a  major  problem.  They  are  still  responsible  for  student  success, 
but  they  are  not  in  charge  of  presenting  the  material.  They  cannot,  for  example,  motivate  students  with 
exciting  lectures  about  the  course  material.  Yet  the  instructor  is  still  responsible  for  motivating  the 
students.  Consequently,  it  becomes  imperative  that  CBT  instructors  realize  the  limitations  which  CBT 
places  on  them  but  also  realize  that  student  success  remains  their  responsibility. 

At  this  point,  “Use  of  silent  reading,  independent  study,  or  written  assignments"  should  be 
discussed.  This  negative  function  (I.e.,  research  has  shown  that  Tl  instructors  who  employ  this  behavior 
produce  lower  levels  of  achievement  than  do  Tl  instructors  who  do  not  use  this  behavior)  is  one  which 
the  CBT  instructor  must  address. 

In  one  sense,  it  could  be  argued  that  CBT  is  in  fact  composed  of  silent  reading,  independent  study, 
and  written  assignments.  It  could  also  be  argued  that  it  is  not  “silent  reading”  that  is  the  issue;  rather, 
the  issue  is  that  Tl  instructors  who  use  this  form  of  instructing  also  employ  other  forms  of  poor 
instruction.  Either  they  do  not  know  the  material  or  they  do  not  know  how  to  teach  it.  Moreover,  such 
an  approach  in  Tl  conveys  to  the  student  that  the  instructor  either  does  not  care  about  teaching  or 
does  not  have  the  capability  to  teach. 
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Table  4.  Tl  Instructor  Functions  Controlled  by  the  CBT  Instructor 


Positive 

« 

Knowledge  about  course  content  demonstrated 

Businesslike  atmosphere  created 

Organized  atmosphere  created 

Focus  placed  on  academics 

High  percentage  of  time  spent  on-task 

Student  behavior  controlled  (non-academic/physicai) 

Students  warned  versus  threatened  over  misconduct 
Student  behavior  monitored 

Attitude  created  that  students  are  accountable  for  their 
performance/achievement 

Negative 

Strong  criticism  given  to  students 
Negative  climate  created 
Time  spent  on  non-academics 
Affective  nature  of  course  emphasized 

Use  of  silent  reading,  independent  study,  or  written  assignments 


If  CBT  instructors  simply  turn  instruction  over  to  CBT,  they  risk  having  their  students  form  the  same 
attitude  they  form  of  Tl  instructors  who  turn  instruction  over  to  “silent  reading."  Preventing  the 
formation  of  this  negative  attitude  is  obviously  a  responsibility  of  the  CBT  instructor.  That  is,  because 
CBT  is  in  effect  “silent  reading,"  CBT  instructors  must  convey  to  their  students  that  the  computer  is 
being  used  to  provide  instruction  because  use  of  the  computer  is  in  the  best  interest  of  the  students’ 
achievement.  In  a  sense  CBT  instructors  are  forced  into  admitting  that  CBT  can  do  a  better  job  of 
instructing  than  they  can,  an  uncomfortable  situation  at  best. 


V.  THE  EFFECTIVE  CBT  INSTRUCTOR’S  ROLE,  BEHAVIOR,  AND  ATTITUDE 

Even  though  CBT  instructors  are  no  longer  directly  presenting  the  course  content,  they  still  have 
responsibility  for  the  students’  achievement.  Therefore,  CBT  instructors  must  do  the  following: 

1 .  Assume  responsibility  for  learning 

-  motivate  students 

-  maintain  students’  interest 

-  maintain  students'  attention/arousal 

-  convey  attitude  that  CBT  is  being  used  to  maximize  achievement 

2.  Insure  high  time-on-task 

-  minimize  transition  time 

-  conduct  quick  start-up 

-  stay  on  task  until  the  end  of  class 

-  be  organized 

-  be  proactive  (prevent  versus  solve  problems) 
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3.  Create  the  proper  learning  environment/ethos 


-  emphasize  pro-per*ormance  versus  pro-compliance 

-  control  physical  setting 

-  create  attitude  in  students  that  they  are  responsible  for  their  performance 

Moreover,  the  CBT  instructor  must  be  (a)  positive,  with  a  can-do/must  do  attitude;  (b)  task-oriented, 
(c)  an  inrernal-locus-of-control  individual;  (d)  warm;  and  (e)  knowledgeable  about  the  subject  material 
and  the  OBT  system, 

Notable  by  its  absence  in  this  discussion  is  the  requirement  for  the  instructor  to  be  a  good  platform 
lecturer.  In  CBT  this  skill  is  not  necessary,  need  not  be  an  instructor  selection  criterion,  and  should 
not  be  used  in  the  instructor  evaluation  system.  Good  instructors  in  CBT  are  those  who  are  effective 
in  that  environment;  i.e.,  they  must  fully  manipulate  the  achievement-related  attitudinal  and  classroom 
atmosphere  variables  still  under  their  control  so  as  to  maximize  achievement.  These  instructors  must 
recognize  that  they  are  no  longer  instructors  in  the  traditional  sense,  but  they  must  also  recognize  that 
they  are  still  responsible  for  student  success.  Therefore,  they  must  use  the  achievement-related 
variables  and  control  them  to  best  advantage. 


VI.  CONTROL  OF  REMAINING  EFFECTIVE  Tl  INSTRUCTOR  FUNCTIONS  IN  CBT 

To  ensure  that  achievement  is  maximized  in  CBT,  ail  of  the  functions  performed  by  the  effective  Tl 
instructor  must  be  accounted  for  in  CBT.  Those  functions  listed  in  Tables  1,  2,  and  3  which  are  not 
controlled  by  the  instructor  in  a  completely  automated  CBT  system  .CBT-instructor-controlled 
functions  are  listed  in  Table  4)  must  be  controlled  by  some  other  aspect  of  tne  CBT  environment.  The 
remaining  effective  Tl  instructor  functions  are  listed  in  Table  5. 

Table  5.  Tl  Instructor  Functions  Not  Controlled 
by  the  CBT  Instructor 


Positive 


Praise  (for  task  performance)  given  to  students 
Mild  reproach  given  to  students 
Neutral  feedback  given  to  slddents 
Student  behavior  controlled  (academic) 

Questions  asked 

Feedback  on  iask  performance  provided 
Frequent  but  short  interactions  held 
Presentations  are  clear,  structured,  and  organized 

Negative 

Non-response  questions  asked 
No  interaction  between  instructor  and  students 


CBT  is  actually  composed  of  four  components:  the  total  CBT  environment  (which  includes  the 
hardware),  the  courseware,  the  CBT  instructor,  and  the  student.  By  manipulating  these  four 
components,  all  effective  Tl  instructor  functions  can  be  provided  in  CBT.  Effective  Tl  functions 
controlled  by  the  CBT  instructor  have  been  discussed  in  Seuions  IV  and  v'.  The  interaction  between 
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CBT  Courseware 


The  CBT  courseware  has  the  primary  responsibility  for  presenting  the  course  material.  Therefore, 
those  functions  listed  In  Table  6  are  the  direct  responsibility  of  the  CBT  courseware  designer.  CBT 
designers  must  ensure  that  these  functions  are  considered  in  the  development  of  CBT  courseware. 

Table  6.  T1  Instructor  Functions  Controlled 
by  CBT  Courseware 


Positive 


Questions  asked 

Presentations  are  clear,  structured,  and  organized 

Negative 

Non-respor  ,e  questions  asked 


The  CBT  courseware  component  has  two  additional  responsibilities.  First,  research  (Stephenson, 
1990c)  has  shown  that  instructoi -student  interaction  can  affect  student  success.  Therefore,  CBT 
designers  should  ensure  that  interaction  is  built  into  the  courseware.  Second,  research  has  also  shown 
that  low-ability  students  seem  to  benefit  more  from  instructor  interaction  than  do  high-ability  students 
(Stephenson,  1990c)  and  that  CBT  instructors  spend  more  time  with  low-ability  students  (Schofield, 
Evans-Rhodes,  ^  Huber,  1989).  Low-ability  students  also  have  different  attitudes  about  CBT, 
depending  on  their  gender  (Dalton,  Hannafin,  &  Hooper,  1989).  Low-ability  students  may  be  the  group 
CBT  can  primarily  impact,  provided  other  factors  such  as  instructor  interaction  are  present.  If  student 
ability  is  not  known,  CBT  designers  should  build  ability  assessment  into  the  courseware  so  that 
instructors  can  quickly  identify  low-ability  students.  Once  these  students  are  identified,  instructors  can 
direct  more  of  their  individual  assistance  towaro  these  students  in  order  to  have  the  greatest  impact 
on  group  achievement. 

Thos^  T!  instructor  functions  still  not  accounted  for  by  either  the  CBT  instructor  or  the  CBT 
courseware  are  presented  ir  "able  7.  These  functions  pose  a  problem  for  CBT  in  that  they  have  been 
shown  to  influence  achievement  in  Tl,  but  they  are  essentially  not  accounted  for  in  CBT.  That  is, 
because  these  functions  are  not  provided  by  either  the  CBT  instructor  or  the  courseware,  they  may  not 
be  present  in  CBT.  The  functions  listed  in  Table  7  must  be  controlled  in  some  way  other  than  by  the 
CBT  instructor  or  the  CBT  courseware. 


CBT  Learning  Environment 

The  functions  listed  in  Table  7  can  be  controlled  in  CBT  by  properly  manipulating  the  CBT  learning 
environment.  In  particular,  if  students  work  CBT  in  dyads  or  triads,  these  functions  will  be  assumed 
by  the  students  themselves.  That  is,  feedback  (praise,  neutral,  and  mild  reproach)  ano  social 
interaction  will  be  provided  by  the  other  member(s)  of  the  dyad/triad.  Justification  for  this  configuration 
of  the  CBT  environment  comas  from  two  sources.  First,  there  is  a  body  of  Tl  literature  on  the  effect  of 
students  working  in  groups  versus  working  individually.  Much  of  the  group  work  has  focused  on  the 
effect  of  cooperation  versus  competition.  The  general  consensus  is  that  students  working  in  small 
groups  produce  higher  achievement  than  do  students  working  alone,  especially  in  a  cooperative  setting 
(Johnson,  Johnson,  &  Stanne,  1985;  Warring,  Johnson,  Maruyama,  &  Johnson,  1985;  Yager,  Johnson, 
&  Johnson,  1985).  The  optimal  group  size  s  '^ms  to  be  either  two  or  three  (Cox  &  Berger,  1985; 
Trowbridge  &  Durnin,  1984;  Webb,  1987)  There  is  also  a  general  consensus  that  paired  students 
should  be  of  like  gender  and  have  similar  abilities  (Dalton,  1 990;  Dossett  &  Hufvershorn,  1 983;  Hooper, 
Ward,  Hannafin,  &  Clark,  1989;  Johnson  et  al.,  1985). 
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Table  7.  H  Instructor  Functions  Hot  Controlled  by  Either 
the  Instructor  or  the  Courseware  in  CBT 


Postive 


Praise  (for  task  performance)  given  to  students 
Mild  reproach  given  to  students 
Neutral  feedback  given  to  students 
Feedback  on  task  performance  provided 
Frequent  but  short  interactions  held 

Negative 

No  interaction  between  instructor  and  students 


The  second  justification  for  arranging  students  in  groups  in  CBT  comes  from  recent  CBT  research. 
There  is  a  general  consensus  that  the  achievement  of  students  working  CBT  in  dyads  or  triads  is  equal 
to  or  surpasses  the  achievement  of  students  working  alone  (Carrier  &  Sales,  1987;  Cox  &  Berger,  1985; 
Dalton,  1990;  Dalton  et  al.,  1989'  Dossett  &  Hulvershorn,  1983;  Hmelo,  1989;  Johnson,  Johnson,  & 
Stanne,  1986;  Justen,  Waldrop,  &  Adams,  1990;  Shull,  1990;  Trowbridge  &  Durnin,  1984;  Webb,  1987). 
“No  study  has  reported  significantly  greater  learning  when  students  work  alone"  (Webb,  1987,  p.  195). 

There  are  many  advantages  associated  with  arranging  students  in  groups.  From  a  pragmatic  view, 
more  students  can  be  trained  by  working  in  teams  than  working  alone.  Students  gain  ideas  and 
information  from  each  other.  Students  learn  from  other  team  members’  actions.  Team  members  give 
each  other  support,  reinforcement,  and  feedback.  Regardless  how  well  the  CBT  courseware  is 
written,  there  will  always  be  some  portion  that  is  unclear.  Students  working  in  teams  are  more  likely 
to  arrive  at  the  correct  conclusion  as  to  what  the  courseware  authors  actually  intended.  In  sum,  team 
members  perform  many  of  the  functions  of  an  instructor  in  a  conventional  setting;  in  fact, 
communication  among  students  may  be  more  effective  than  communication  between  students  and  an 
instructor  (Webb,  1987). 

Several  authors  have  suggested  two  caveats  to  tiiese  findings.  First,  if  the  results  show  that 
students  in  groups  outperform  students  working  alone,  why  are  tti^-re  not  more  group-learning  settings? 
A  suggested  answer  is  that  teachers  have  not  been  taught  to  teach  students  arranged  in  groups 
(Talmage  Pascarella,  &  Ford,  1984).  No  matter  what  the  research  literature  shows,  if  the  classroom 
teacher  is  not  comfortable  with  groups,  students  will  not  be  arranged  in  groups.  Second,  students  are 
not  used  to  working  in  groups  (Dalton,  1990).  Unless  prepared  to  work  as  a  group,  students  assigned 
to  worx  CBT  in  teams  may  resort  to  social  loafing  or  other  off-task  behavior. 

In  summary,  there  seems  to  be  strong  support  for  having  students  work  CBT  in  dyads  or  triads. 
Moreover,  CBT  may  be  a  more  logical  environment  for  study  groups  than  is  Tl.  In  Tl,  grouped  students 
are  in  conflict  with  the  norm  of  working  alone.  Also,  working  in  groups  "squires  a  de'inite  change  for 
the  Tl  instructor.  However,  *here  is  no  established  norm  in  CBT;  therefore,  working  in  study  teams  is 
as  logical  as  working  alone.  Plus,  working  CBT  in  groups  versus  alone  has  relatively  no  impact  on  the 
instructor. 

The  bottom  line  seems  to  be  that  proper  arrangement  of  the  CBT  environment  permits  the  functions 
listed  in  Table  7  to  be  accounted  for  in  CBT.  Therefore,  all  of  the  Tl  instructor  functions  listed  in  Tables 
1 ,  2.  and  3  can  be  accounted  for  in  CBT. 
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CBT  Students 


CBT  designers  often  fail  to  consider  the  role  of  the  student,  and  to  simply  assume  that  the  CBT 
student's  role  does  not  change.  However,  the  dramatic  changes  in  the  delivery  system  do  not  go 
unnoticed  by  the  student.  To  properly  transition  students  into  CBT,  they  should  be  adequately 
prepared.  For  instance,  they  should  feel  comfortable  with  the  delivery  system  prior  to  beginning 
training.  This  would  include,  of  course,  being  comfortable  with  a  computer.  That  is  not  to  suggest  that 
students  need  to  know  how  to  program,  (e.g.,  in  BASIC),  but  it  does  suggest  that,  at  a  minimum, 
students  should  know  how  to  keyboard,  if  not  type.  At  some  point,  the  computer  terminal  must  become 
to  the  student  simply  a  necessary  piece  of  equipment  whose  internal  workings  need  not  be  understood. 
Moreover,  if  the  students  are  to  be  arranged  in  study  teams,  as  suggested  above,  then  students  need 
to  be  trained  in  how  to  act  as  a  team.  Most  students  have  a  lifelong  history  of  working  by  themselves 
and  have  had  little  experience  working  in  cooperation.  It  is  unreasonable  to  assume  they  will  easily 
adapt  to  working  in  teams  without  preparation. 

CBT  impacts  students  as  well  as  other  components  of  the  learning  system,  and  students  must  be 
properly  prepared.  Such  preparation  takes  time,  money,  and  effort.  However,  by  admitting  that  extra 
time,  money,  and  effort  must  be  spent  on  student  preparation,  CBT  advocates  leave  themselves  open 
to  the  criticisms  expressed  by  Clark  (1983),  Hagler  and  Knowlton  (1987),  and  Johnson  et  al.  (1985). 
These  and  other  authors  point  out  that  if  the  same  amount  of  time,  money,  and  effort  were  put  into 
improving  an  existing  Tl  system,  increased  performance  and  reduced  learning  time  might  result  in  that 
environment  also. 


VII.  OTHER  FACTORS 

Several  other  factors  related  to  the  CBT  environment  should  also  be  discussed.  If  students  are 
going  to  be  organized  into  study  teams,  the  teacher  must  be  proficient  at  working  with  these  teams.  It 
was  previously  pointed  out  that  students  have  a  history  of  working  alone.  Instructors  have  a  similar 
background.  Therefore,  not  only  must  instructors  be  prepared  to  transition  to  CBT,  they  must  also  be 
prepared  to  transition  to  an  environment  in  which  students  are  interacting  among  themselves. 

If  students  are  going  to  be  working  CBT  in  teams,  the  courseware  should  take  this  into  account. 
CBT  software  should  be  written  to  acknowledge  that  more  than  one  student  is  at  the  terminal;  e.g.,  the 
courseware  should  be  written  to  require  a  response  from  each  team  member. 

CBT  instructors  must  also  be  prepared  to  spend  more  of  their  time  with  low-ability  students. 
Low-ability  students  seem  to  benefit  least  from  CBT,  at  least  for  learning  course  material  with  some 
degree  of  difficulty  (Adams,  Waldrop,  Justen,  &  McCrosky,  1987;  Hattva  &  Shorer,  1989;  Klein  &  Keller, 
1990;  Stephenson,  1990c;  Whitney  &  Urquhart,  1990).  However,  instructor  interaction  seems  to  have 
a  positive  effect  on  low-ability  students  in  CBT  (Schofield  et  al.,  1989;  Stephenson,  1990c);  i.e., 
increased  instructor  Interaction  increases  student  achievement.  Moreover,  instructors  who  have 
transitioned  from  Tl  to  CBT  report  that  they  spend  more  time  with  low-ability  students  in  CBT  than  they 
did  in  Tl  (Schofield  6t  al.,  1989). 

Instructor  preparation  is  obviously  very  critical  to  the  success  of  CBT.  Instructors  must  be 
knowledgeable  concerning  the  operation  of  the  CBT  system.  CBT  instructors  also  need  to  be  aware 
that  they  are  going  to  be  supervising  study  teams  and  that  they  are  going  to  be  spending  more 
one-on-one  time  with  low-ability  students. 

CBT  implementors  should  not  assume  that  Tl  instructors  know  all  of  the  above.  Upon  being  placed 
in  CBT,  most  Tl  instructors  will  act  as  they  have  always  acted  in  the  Tl  classroom.  However,  different 
skills  are  needed  in  CBT.  CBT  instructors  must  be  selected,  trained,  and  evaluated  using  criteria  from 
CBT.  Moreover,  CBT  implementors  should  realize  that  the  role  of  the  instructors’  supervisors  will 
change.  Supervisors  may  try  to  evaluate  CBT  instructors  by  means  of  the  more  familiar  Tl  criteria 
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rather  than  effective  CBT  criteria.  “Interestingly,  the  chairman  of  the  math  department  mentioned  to 
our  project  staff  that  he  could  not  evaluate  teachers  using  the  intelligent  tutors  (CBT)  very  well  since 
those  classes  were  run  so  differently  from  ordinary  ones  and  different  teaching  skills  were  needed" 
(Schofield  etal.,  1989,  p.  14). 

Another  factor  concerns  the  interaction  between  the  instructor  and  the  courseware.  No  courseware 
can  be  perfect;  there  will  always  be  some  aspect  or  problem  that  could  be  improved  or  corrected. 
Given  that  CBT  instructors  will  probably  be  the  first  to  recognize  such  problems,  they  play  an  important 
role.  First,  an  instructor  can  provide  feedback  to  the  CBT  courseware  designers  about  the  problem. 
Second,  an  instructor  can  assure  that  the  students  are  aware  of  any  courseware  problem  and  that  it 
does  not  become  a  barrier.  Actually,  for  minor  problems,  this  situation  would  be  advantageous  in  that 
it  would  give  CBT  instructors  a  natural  opportunity  to  interact  with  the  students. 

Another  issue  concerns  instructor  knowledge  of  course  content.  A  natural  assumption  is  that  the 
instructor  must  be  knowledgeable  about  the  course  material.  However,  in  CBT,  the  instructor  is  not 
the  primary  source  of  knowledge;  the  courseware  assumes  that  role.  Consequently,  CBT  instructors 
do  not  have  to  “know"  all  there  is  to  know  about  the  material;  however,  they  do  have  to  know  the 
answers  to  the  usual  questions  the  students  will  ask.  After  a  few  classes,  these  questions  will  be  known. 

The  same  logic  holds  for  knowledge  about  the  CBT  system.  Over  time,  the  recurring  “fixable” 
problems  will  become  known,  and  CBT  instructors  will  know  how  to  correct  them.  Instructors  are  not 
expected  to  fix  serious  problems  in  any  training  delivery  system,  and  such  problems  should  not  be  an 
issue  in  CBT.  CBT  instructors  do  not  need  to  be  either  expert  tutors  or  expert  systems  analysts. 

Another  change  frequently  overlooked  during  CBT  implementation  is  that  any  change  in  a  training 
system  may  have  a  greater  than  anticipated  impact  on  the  organization.  For  instance,  Whitney  and 
Urquhart  (1990)  reported  that  a  two  semester  project  to  teach  college  level  mathematics  using  CBT 
produced  several,  unforeseen  by-products.  Course  content  changed  as  a  result  of  the  new  computer 
capability  available  with  CBT.  Instructors  worked  longer  and  harder  than  before  CBT  was  adopted. 
The  impact  on  the  CBT  project  on  the  departmental  budget  and  support  staff  was  larger  than 
anticipated.  A  portion  of  class  time  had  to  be  devoted  to  computer  operation  versus  normal  course 
content.  For  these  reasons,  plus  the  fact  that  the  CBT  approach  did  not  help  the  weaker  students  as 
much  as  hoped  for,  the  authors  indicated  that  they  would  propably  not  adopt  CBT  again. 

A  final  issue  concerns  an  argument  typically  presented  as  the  reason  for  adopting  CBT:  the 
argument  that  CBT  closely  approximates  the  ideal  learning  situation  of  a  one-on-one  tutorial.  As 
suggested  above,  research  shows  that  students  working  in  either  dyads  or  triads  outperform  students 
working  alone.  Also,  current  CBT  courseware  does  not  approximate  what  master  tutors  do  (Lepper  & 
Gurtner,  1989).  These  results  certainly  run  counter  to  the  one-on-one  tutorial  argument  and  suggest 
that  this  argument  should  be  dropped  as  a  selling  point  for  CBT. 

It  might  be  more  accurate  to  simply  argue  that,  provided  all  of  the  issues  presented  in  this  paper 
are  attended  to,  CBT  can  do  a  better  job  than  Tl  in  some  situations.  This  approach  views  CBT  as  only 
one  of  many  training  delivery  systems  and  permits  the  course  designer  to  focus  on  the  basic  question 
“Which  delivery  system  is  best  for  my  objective?"  If  CBT  is  determined  to  be  the  best  delivery  system, 
the  course  designer  must  attend  to  the  issues  raised  in  this  paper.  If  not  attended  to,  the  adopted  CBT 
system  will  either  fall  or  operate  at  less  than  an  optimal  level. 


VIII.  SUMMARY  AND  RECOMMENDATIONS 

There  are  known  Tl  instructor  variables  which  affect  achievement.  However,  not  all  of  these 
variables  remain  under  the  control  of  the  instructor  in  CBT.  To  maximize  achievement  in  CBT,  effective 
Tl  instructor  functions  should  be  provided  somewhere  in  the  total  CBT  environment.  The  following 
recommendations  are  offered  for  accomplishing  this  goal. 
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Instructors 


CBT  instructor  selection  should  focus  on  individuals  who  assume  responsibility  for  learning,  ensure 
high  time-on-task,  and  create  the  proper  learning  environment/ethos.  Moreover,  the  CBT  instructor 
must  be  (a)  positive,  with  a  can-do/must-do  attitude;  (b)  task-oriented;  (c)  an  internal  locus-of-control 
individual;  (d)  warm;  and  (e)  somewhat  knowledgeable  about  the  subject  material  and  the  CBT  system. 

CBT  instructors  do  not  have  to  be  expert  in  either  their  field  or  CBT.  The  source  of  motivation  for 
the  students  will  not  be  the  instructors’  knowledge.  Instead,  it  will  come  from  the  overall  achievement 
attitude  created  in  the  classroom. 

CBT  instructors  should  also  be  trained  to  supervise  study  teams  and  to  be  effective  working 
one-on-one  with  low-ability  students.  Instructor  preparation  should  not  emphasize  presentation  skills 
or  course  knowledge.  Instead,  CBT  instructor  training  should  emphasize  the  specifics  of  the  effective 
CBT  environment. 


Courseware 


In  addition  to  containing  the  appropriate  principles  of  course  material  presentation,  CBT 
courseware  should  require  instructor-student  interaction.  Because  CBT  instructors  will  be  spending 
proportionately  more  time  with  low-ability  students,  a  method  for  quickly  assessing  student  ability  level 
should  be  incorporated  into  the  courseware.  Finally,  courseware  should  be  written  under  the 
assumption  that  it  will  be  used  by  students  working  in  teams. 


Environment 


Students  should  work  CBT  in  dyads  or  triads.  Students  should  be  teamed  by  like  gender  and  similar 
ability. 


Students 


Students  should  be  prepared  in  advance  on  how  to  work  on  a  computer  and  how  to  work  in  dyad 
or  triad  study  teams. 


Other 


The  CBT  system  should  be  structured  to  allow  feedback  on  the  courseware  from  the  instructor  to 
the  courseware  designers. 


IX.  CONCLUDING  COMMENTS 

The  behavior  and  attitude  of  the  instructor  in  CBT  are  crucial  to  both  the  success  of  the  CBT  system 
and  the  achievement  level  attained  by  the  students  who  use  CBT.  This  paper  has  emphasized  how  the 
role  of  the  instructor  and  other  variables  impact  student  achievement.  However,  whether  or  not  a  CBT 
system  is  even  implemented  is  often  a  function  of  how  well  the  system  is  received  by  in-place 
instructors.  Two  of  the  underlying  reasons  why  the  implementation  of  CBT  may  be  resisted  by 
instructors  are  (a)  the  fear  of  not  knowing  how  they  will  fit  into  the  new  environment,  and  (b)  the  fear 
that  they  will  not  retain  control  of  the  CBT  classroom.  I  have  tried  to  counter  these  fears  by  tying  CBT 
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to  the  familiar  Tl  situation  and  by  providing  a  detailed  account  of  recognizable  factors  that  must  be 
considered  when  implementing  CBT. 

In  CBT,  instructors  are  still  a  vital  part  of  the  learning  environment,  and  they  still  can  control  the 
environment.  The  only  real  issue  for  an  instructor  considering  CBT  is  this:  “Is  CBT  appropriate  for  my 
situation?”  If  the  answer  is  “yes,"  instructors  can  use  this  paper  to  ascertain  the  steps  they  will  have 
to  take  to  ensure  that  the  total  CBT  environment  (to  include  the  instructor)  is  properly  configured  to 
maximize  student  achievement. 
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